BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on REG-TOTAL events by Ev. Decom. - Approx. Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[REG-TOTAL]==       1940 (  672)     1409 (  672)    34.64    47.69    40.13
[ConcordU ]       ==[REG-TOTAL]==       1940 (  583)     1041 (  583)    30.05    56.00    39.11
[JULIELab ]       ==[REG-TOTAL]==       1940 (  666)     1724 (  666)    34.33    38.63    36.35
[UT+DBCLS ]       ==[REG-TOTAL]==       1940 (  521)     1168 (  521)    26.86    44.61    33.53
[VIBGhent ]       ==[REG-TOTAL]==       1940 (  375)      952 (  375)    19.33    39.39    25.93
[  UNSW   ]       ==[REG-TOTAL]==       1940 (  350)      962 (  350)    18.04    36.38    24.12
[ UZurich ]       ==[REG-TOTAL]==       1940 (  322)      806 (  322)    16.60    39.95    23.45
[ UTokyo  ]       ==[REG-TOTAL]==       1940 (  288)      757 (  288)    14.85    38.04    21.36
[   Cam   ]       ==[REG-TOTAL]==       1940 (  212)      455 (  212)    10.93    46.59    17.70
[UAntwerp ]       ==[REG-TOTAL]==       1940 (  226)      678 (  226)    11.65    33.33    17.27
[  SCAI   ]       ==[REG-TOTAL]==       1940 (  265)     1269 (  265)    13.66    20.88    16.52
[ Team 24 ]       ==[REG-TOTAL]==       1940 (  192)      801 (  192)     9.90    23.97    14.01
[CNBMadrid]       ==[REG-TOTAL]==       1940 (  352)     3662 (  352)    18.14     9.61    12.57
[  NICTA  ]       ==[REG-TOTAL]==       1940 (  152)      751 (  152)     7.84    20.24    11.30
[  UMich  ]       ==[REG-TOTAL]==       1940 (  314)     3886 (  314)    16.19     8.08    10.78
[ UAveiro ]       ==[REG-TOTAL]==       1940 (  128)      494 (  128)     6.60    25.91    10.52
[ASU+HU+BU]       ==[REG-TOTAL]==       1940 (  106)      257 (  106)     5.46    41.25     9.65
[CIPS-ASU ]       ==[REG-TOTAL]==       1940 (  204)     2405 (  204)    10.52     8.48     9.39
[ USzeged ]       ==[REG-TOTAL]==       1940 (   85)      379 (   85)     4.38    22.43     7.33
[ UNIMAN  ]       ==[REG-TOTAL]==       1940 (   80)      400 (   80)     4.12    20.00     6.84
[CCP-BTMG ]       ==[REG-TOTAL]==       1940 (   56)      115 (   56)     2.89    48.70     5.45
[ Team 09 ]       ==[REG-TOTAL]==       1940 (   46)      343 (   46)     2.37    13.41     4.03
[  PIKB   ]       ==[REG-TOTAL]==       1940 (   23)       59 (   23)     1.19    38.98     2.30
[ KoreaU  ]       ==[REG-TOTAL]==       1940 (   12)       32 (   12)     0.62    37.50     1.22

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[REG-TOTAL]==       1994 (  527)     1180 (  527)    26.43    44.66    33.21
[UAntwerp ]       ==[REG-TOTAL]==       1994 (  234)      698 (  234)    11.74    33.52    17.38
[ Team 24 ]       ==[REG-TOTAL]==       1994 (  203)      819 (  203)    10.18    24.79    14.43
[CNBMadrid]       ==[REG-TOTAL]==       1994 (  370)     4285 (  370)    18.56     8.63    11.79
[ASU+HU+BU]       ==[REG-TOTAL]==       1994 (  106)      257 (  106)     5.32    41.25     9.42
[CCP-BTMG ]       ==[REG-TOTAL]==       1994 (   56)      115 (   56)     2.81    48.70     5.31

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------